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This paper is about the design and analysis of an index-assignment (IA) based multiple-description 
coding scheme for the n-channel asymmetric case. We use entropy constrained lattice vector quantization 
and restrict attention to simple reconstruction functions, which are given by the inverse IA function when 
all descriptions are received or otherwise by a weighted average of the received descriptions. We consider 
smooth sources with finite differential entropy rate and MSE fidelity criterion. As in previous designs, our 
construction is based on nested lattices which are combined through a single IA function. The results are 

oo : 

exact under high-resolution conditions and asymptotically as the nesting ratios of the lattices approach 

O ■ 

infinity. For any n, the design is asymptotically optimal within the class of IA-based schemes. Moreover, 
in the case of two descriptions and finite lattice vector dimensions greater than one, the performance is 
strictly better than that of existing designs. In the case of three descriptions, we show that in the limit of 
large lattice vector dimensions, points on the inner bound of Pradhan et al. can be achieved. Furthermore, 

for three descriptions and finite lattice vector dimensions, we show that the IA-based approach yields, 

rS ' 

in the symmetric case, a smaller rate loss than the recently proposed source-splitting approach. 
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I. Introduction 

Multiple-description coding (MDC) is about (lossy) encoding of information for transmission over an 
unreliable n-channel communication system. The channels may break down resulting in erasures and 
a loss of information at the receiving side. The receiver knows which subset of the n channels that 
are working; the transmitter does not. The problem is then to design an MDC system which, for given 
channel rates, minimizes the distortions due to reconstruction of the source using information from any 
subsets of the channels. 

The achievable multiple-description (MD) rate-distortion function is completely known for the case of 
two channels, squared-error fidelity criterion and the memoryless Gaussian source HI, |2). An extension 
to colored Gaussian sources was provided in Inner and outer bounds to the n-channel quadratic 

Gaussian rate-distortion region for memoryless sources was presented in ||6l- |[TTTl . 

Practical symmetric multiple-description lattice vector quantization (MD-LVQ) based schemes for two 
descriptions have been introduced in lfT2ll . which in the limit of infinite-dimensional source vectors and 
under high-resolution assumptions, approach the symmetric MD rate-distortion boundO An extension to 
n > 2 descriptions was presented in |fl3l . Asymmetric MD-LVQ was considered in lfl4ll for the case of 
two descriptions. Common for all of the designs |[T2l - |[T4l is that a central quantizer is first applied on 
the source after which an index-assignment (IA) algorithm (also known as a labeling function) maps the 
reconstruction points of the central quantizer to reconstruction points of the side quantizers, which is an 
idea that was first presented in |fl31 . These designs are usually referred to as IA based designs. 

There also exists non IA based n-channel schemes, which are proven optimal in the two-channel 
quadratic Gaussian case. In particular, the source-splitting approach of Chen et al. |[T6l and the delta- 
sigma quantization approach of 0stergaard et al. ifTTl . lPT8ll . In addition, the following recent work |fT9l , 
|[20l . provide simple constructions that are approximately optimal^ 

While the different designs mentioned above are able to achieve the rate-distortion bounds in the 
asymptotical limit as the lattice vector quantizer dimension (L) gets arbitrarily large, there is an inherent 
rate loss when finite dimensional vector quantizers are employed^ For example, in the two-channel 
symmetric case and at high resolutions, the rate loss (per description) of the IA based schemes is given by 

'The term symmetric relates to the situation where all channel rates (description rates) are equal and the distortion depends 
only upon the number of working channels (received descriptions) and as such not on which of the channels that are working. 
In the asymmetric case, the description rates and side distortions are allowed to be unequal. 

2 Note that the recent works 1 1 7 1 — 1 20 1 appeared after the first submission of this paper. 

3 The term rate loss refers to the excess rate due to using a suboptimal implementation. 
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| log 2 (G(A( i ))G(S , L)(27re) 2 ) where G(A( L )) is the dimensionless normalized second moment of the L- 
dimensional lattice A^ L ) and G(Sl) is the dimensionless normalized second moment of an L-dimensional 
hypersphere [21]. For the source-splitting approach the rate loss is \ log 2 (G(A^^) 3 (27re) 3 ) whereas 
for the delta-sigma quantization approach the rate loss is \ log 2 (G ! (A( I '') 2 (27re) 2 ). Since G(Sl) < 
G(A( L )),VL > 0, it follows that the IA based approaches yield the smallest rate loss of all existing 
asymptotically optimal designs^ 

We will like to point out that there exist a substantial amount of different practical approaches to MDC. 
For example, the work of [22 ] on asymmetric vector quantization, the work of 1251 . E4l on n-channel 
scalar quantization and the transform based MDC approaches presented in |[25l - |[28l . 

In this paper, we are interested in IA based MDC. Specifically, we propose a design of an asymmetric 
IA based MD-LVQ scheme for the case of n > 2 descriptions. The design uses a single labeling function 
and simple reconstruction functions, which are given by the inverse IA function when all descriptions are 
received or otherwise by a weighted average of the received descriptions. We consider the case of MSE 
distortion and smooth sources with finite differential entropy ratejf] To the best of the authors knowledge, 
the above restrictions (or even less general restriction) are also necessary for the existing IA-based designs 
proposed in the literature. 

The contributions of the paper are summarized below and are valid under high-resolution conditions 
and asymptotically large nesting ratios: 

• We provide a simple construction of the labeling function for the asymmetric case and for any number 
n > 2 of descriptions. The construction is optimal within the framework of IA based schemes where 
only a single IA function is used and where the reconstruction rule is given as the average of the 
received descriptions (or the central lattice in case all descriptions are received). 

• For n = 3 and any L > 1, we provide closed-form rate-distortion expressions. 

• For n = 3 and in the limit as L — > oo, the distortion points of our scheme lie on the inner bound 
provided by Pradhan et al. Q, 1H. 

• For n = 2 and any 1 < L < oo, we strictly improve the side distortions (by a constant) over that of 
the asymmetric design by Diggavi et al. lfl4l . 

4 By use of time-sharing, the rate loss of the source-splitting scheme can be reduced to that of the delta-sigma quantization 
scheme. Moreover, in the scalar case, the rate loss can be further reduced, see 1 16 1 for details. 

5 For each side description, we assume that the sequence of quantized source vectors is jointly entropy coded using an arbitrarily 
complex entropy coder. 
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• For n = 3 and 1 < L < oo, we define a notion of rate loss (in the symmetric case only) as the 
difference between the operational rate of the scheme and the rate of the inner bound of Pradhan 
et al. Q, (HI. We then show that our construction yields a smaller rate loss than that of source- 
splitting urn. 

This paper is organized as follows. In Section [II] we briefly review some lattice properties, describe 
the required asymptotical conditions which we will be assuming through-out the work, and introduce the 
concept of an IA function. The actual design of the MD-LVQ system, which is the main contribution of 
the paper, is presented in Section [nil In Section [iVl we compare the proposed design to known inner 
bounds and existing MD schemes. The conclusions follow in Section [V] and appendices are reserved for 
lengthy proofs. 

II. Preliminaries 

A. Lattice Properties 

Let the L-dimensional real lattice A C ffi L form the codewords of the lattice vector quantizer Qa(-) 
having Voronoi cells. Thus, Qa(x) = A if x G V(A) where V(A) = {x G M L : \\x — A|| 2 < \\x — 
A'|| 2 , VA' G A} is a Voronoi cell. We define (x,x) = j^x t x and use ||x|| 2 = (x,x). The dimensionless 
normalized second-moment of inertia G(A) of A is defined as II2T1 

U 1+1 I L Jv(p) 

where V(0) is the Voronoi cell around the origin and v denotes the volume of V(0). Recall that ^ > 
G(A) > G(Sl) > where G(Sl) = (l+2)w ^ (f ^) ^ s ^ e dimensionless normalized second 
moment of an L-dimensional hypersphere and T(-) is the Gamma function |2T1 . 

Let A be a lattice, then a sublattice A s C A is a subset of the elements of A that is itself a lattice. We 
say that A s is a coarse lattice nested within the fine lattice A. Let v and u s be the volumes of V(0) and 
V s (0), respectively, where the subscript s indicates the sublattice. Then the index value N s of A s with 
respect to A is N s = v s jv and the nesting ratio N' s is given by N' s = y/Ng. 

Let {A^^} be a sequence of lattices indexed by their dimension L. Then, A^ is said to be asymp- 
totically good for quantization (under MSE) if and only if for any e > and sufficiently large L |[29l 

log 2 (2^eG(A( L ))) <e. (2) 
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B. The Existence of Lattices and Sublattices for MD coding 

We need a central lattice (central quantizer) A c with Voronoi cell V c (0) of volume v c and n sublattices 
(side quantizers) Aj C A c with Voronoi cells Vi(0) of volumes Vi, where i = 0, ... , n — 1. Finally, we 
need a sublattice A^ C Aj which we will refer to as a product lattice. The Voronoi cell V w (0) of A„- has 
volume u n = N^Vc where N n is the index value of A^ with respect to A c . 

Previous work on two-description IA based MD coding focused on the existence and construction of 
nested lattices for a few low dimensional (root) lattices cf. |[12l . Ifl4l . The techniques of |[12ll . Ifl4ll was 
extended to the case of n descriptions for the symmetric case in lTT3l . While some of the root lattices 
are considered to be among the best of all lattices (of the same dimensions) for quantization, they are 
not good for quantization in the sense of ([2]). Furthermore, their index values belong to some discrete 
sets of integers and since they are finite dimensional, arbitrary nesting ratios cannot be achieved. 

Let us first clarify the requirements of the lattices to be used in this work: 

1) The central lattice A c G M L , is asymptotically good for quantization as L — > oo. 

2) The central lattice A c G IR L admits sublattices Aj C A c of arbitrary nesting ratios 1 < N[ G K. 

3) There exists a product lattice A^ C Aj,i = 0, ... ,n — 1, with arbitrary nesting ratio N'^ (with 
respect to A c ) where N- < G R for all i = 0, . . . , n - 1. 

That there exists a sequence of lattices which are asymptotically good for quantization was established 
in (3(3. It is also known that there exists nested lattices A^ C Ac where the coarse lattice (A( L )) 
is asymptotically good for quantization and the fine lattice (A^) is asymptotically good for channel 
coding im . Moreover, in recent work [32], it has been established that there exists a sequence of nested 
lattices where the coarse lattice as well as the fine lattice are simultaneously good for quantization. 

Interestingly, we do not require {Aj}™^ 1 nor A^ to be good for quantization. This is because we are 
able to construct a labeling function which, asymptotically as Ni — > oo,Vi, results in a distortion that 
becomes independent of the type of sublattices being used. Furthermore, A^ is used to provide a simple 
construction of a shift invariant region V n (0i) and its quantization performance is therefore irrelevant. 

We have yet to show the existence of A^ C A- L ^ for i = 0, . . . , n — 1. Towards that end, we refer 
to the construction of nested lattices provided in |[32l . Here a coarse lattice A^ is first fixed and then 
a fine lattice \[ L ^ is constructed such that A^ C a{ L ^ with an arbitrary nesting ratio. Without loss 
of generality, let < N[ < • • • < N' n _ l < N'^. Moreover, let the set of integers Z L form a product 
lattice Ai L) . Now let A^ be the coarse lattice and construct a fine lattice A^Jj so that the nesting 
ratio is A^/A^_ 1 by using the method of [32]. Next, let A^ be the coarse lattice and construct a fine 
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lattice A^_ 2 with a nesting ratio of N' n _ l /N! n _ 2 . This procedure is repeated until the sublattice Aq L ^ is 
constructed as the fine lattice of . At this point, the central lattice A c ^ is finally constructed by using 
A { L) as the coarse lattice and making sure that the nesting ratio is Nq. It should be clear that we end up 
with a sequence of nested lattices, i.e. A^ C Aj l _ 1 C • • • C A Q L ^ C Ac with the desired nesting ratios 
with respect to A c , i.e. jV£, N' n _ x ,- ■■ ,N' Q . Without loss of generality, we can take = H^~q 

In the limit as L — > oo it is guaranteed that A c becomes asymptotically good for quantization. 
Furthermore, the sublattices A- L ^ can be shaped so that they are also good for quantization or they can, 
for example, be shaped like the cubic lattice. This is not important for the design proposed in this work. 

C. Lattice Asymptotics 

As is common in IA based MD-LVQ, we will in this work require a number of asymptotical conditions 
to be satisfied in order to guarantee the prescribed rate-distortion performance. Specifically, we require 
high-resolution conditions, i.e. we will be working near the limit where the rates of the central and 
side quantizers diverge towards infinity, or equivalently, in the limit where the volumes of the Voronoi 
cells of the lattices in question become asymptotically small. This condition makes it possible to assume 
an approximately uniform source distribution over small regions so that standard high-resolution lattice 
quantization results become valid [331 . Let A C M L be a real lattice and let v = det(A) be the volume 
of a fundamental region of A. Moreover, let V C M L be a connected region of volume v. Then, the 
high-resolution assumption makes it possible to approximate the number of lattice points inVbyv/v, 
which is an approximation that becomes exact as the number of lattice shells within V goes to infinity. To 
be more specific, let S(c, r) be a sphere in M L of radius r and center c G M L . Then, according to Gauss' 
counting principle, the number A% of integer lattice points in a convex body C in M L equals the volume 
Vol(C) of C with a small error term [34]. In fact if C = S(c, r) then by use of a theorem due to Minkowski 
it can be shown that, for any c G M L and asymptotically as r — > oo, Az{r) = Vol(S(c,r)) = ujir L , 
where lol is the volume of the L-dimensional unit sphere [35]. It is also known that the number of 
lattice points A^(j) in the first j shells (i.e., the j shells nearest the origin) of the lattice A satisfies, 
asymptotically as j oo, = Wij L//2 /z/ lfi2l . 

In addition to the high-resolution assumption, we also require that the index values of the sublattices 
become asymptotically large. With this, it follows that the number of central lattice points within a 

6 If 1 < m < n nesting ratios are identical, we keep only one of them when forming the product lattice. If all nesting ratios 
are identical, we form the product lattice based on the product of any two of them, see [l3 | for details. 
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Voronoi cell of a sublattice becomes arbitrarily large. Furthermore, to guarantee that the sublattices 
satisfy the high-resolution quantization properties, we must force the volume of their Voronoi cells to 
be small. In other words, we require that /Vj — > oo and — > where V{ = vNi is the volume of a 
Voronoi cell of the ith sublattice. We also note that, in order to avoid that some subset of the sublattices 
asymptotically dominate the overall distortion, we will require that their index values grow at the same 
rate, i.e. Ni/Nj = Cij for some constant a : j G R. 

Finally, as mentioned in the previous section, we require the existence of good lattices for quantization. 
We therefore require that the lattice vector dimension L tends towards infinity. 

We note that the above asymptotical conditions are only required to guarantee exact results. In fact, 
at some point, we relax the requirement on L and provide exact results for any L > 1. Moreover, the 
proof technique is constructive in the sense that in non-asymptotical situations, i.e. for finite iVj and Ri, 
the results are approximately true. This is interesting from a practical perspective, since, in practice, the 
asymptotical conditions will never be truly satisfied. 

D. Index Assignments 

In the MDC scheme considered in this paper, a source vector x is quantized to the nearest reconstruction 
point A c in the central lattice A c . Hereafter follows IAs (mappings), which uniquely map all A c 's to 
reproduction points in each of the sublattices Aj. This mapping is done through a labeling function a, 
and we denote the individual component functions of a by aij. In other words, the function a that maps 
A c into A x ••• x A n _i, is given by a(A c ) = (a (A c ), ai(A c ), . . . , a n _i(A c )) = (A , Ai, . . . , A„_i), 
where aj(A c ) = Aj G A, and i = 0, . . . , n — 1. Each n-tuple (Ao, • • • , A n _i) is used only once when 
labeling points in A c so that A c can be recovered unambiguously when all n descriptions are received. 

Since lattices are infinite arrays of points, we adopt the procedure first used in [12] and construct 
a shift invariant labeling function, so we only need to label a finite number of points. We generalize 
the approach of lfl4l and construct a product lattice A„- which has central lattice points and N n /Ni 
sublattice points from the ith sublattice in each of its Voronoi cells. The Voronoi cells ^(A^) of the 
product lattice A^ are all similar so by concentrating on labeling only central lattice points within one 
Voronoi cell of A^, the rest of the central lattice points may be labeled simply by translating this Voronoi 
cell throughout R L . We will therefore only label central lattice points within K-(O), which is the Voronoi 
cell of A n around the origin. With this we get 

a(A c + A,,) = a(A c ) + A^ (3) 

for all X n G A w and all A c G A c . 
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III. Construction of the Labeling Function 

This section focuses on the labeling problem and is split into several subsections. We begin by Sec- 
tion IIII-AI which shows how to guarantee shift invariance of the labeling function. Then, in Section IIII-BI 
we define the cost function to be minimized by an optimal labeling function. In Section IIII-CI we show 
how to construct an optimal set of n-tuples and the assignment of the n-tuples to central lattice points 
follows Section IIII-DI We end by assessing the rate and distortion performances of the labeling function 
in Section IIII-EI and Section IIII-FI respectively. 

A. Guaranteeing Shift Invariance of the Labeling Function 

In order to ensure that a is shift-invariant, we must make sure that an n-tuple is not assigned to more 
than one central lattice point A c G A c . Notice that two n-tuples which are translates of each other by 
some \ n € must not both be assigned to central lattice points located within the same region V 7r (X. n -), 
since this causes assignment of an n-tuple to multiple central lattice points. 

The region V n (0) will be translated through-out M L and centered at X n £ A n . Assume that A^ is clearQ 
with respect to Ao- Then no points of Ao will be inside more than one ^(A^) region. This is the key 
insight required to guarantee shift invariance. Let us now construct an n-tuple, say (Ao, Ai, . . . , A„_i), 
where the first element is inside K-(O), i.e. Ao G V n (0). Once we shift the n-tuple by a multiple of A„-, the 
first element of the shifted n-tuple will never be inside V^-(O) and the n-tuple is therefore shift invariant. 
In other words, (Ao + \ n ) £ K-(O) for ^ \ w £ A n . This also means that all n-tuples (for A c E K-(O)) 
have their first element (i.e. Ao) inside V n (0). This restriction is easily removed by considering all cosets 
of each n-tuple. Let us define the coset of an n-tuple modulo A^ to be 

Ca x (Ao, • • • , A„_i) = 

(4) 

{(A ,...,A / „_ 1 )eA x ••• xA„_i : A- = A* + A 7r ,A 7r e A n }. 
The n-tuples in a coset are equivalent modulo A^. So by allowing only one member from each coset to 
be used when assigning n-tuples to central lattice points within K-(O), the shift-invariance property is 
preserved *] 

7 A sublattice A s C A is said to be clean with respect to A if no points of A falls on the boundary of the Voronoi cells of 
A s . In other words, the set {A g A : A £ V S (A S ) CI V„(X' g )} is empty for all A s 7^ A' s G A s . We note that it is an open problem 
to construct a sequence of nested lattices which are asymptotically good for quantization and where the coarse lattice is clean. 

8 If A^ is not clean, a similar coset construction may be used to systematically deal with the boundary points: First, all 
boundary points which are equivalent modulo are within the same coset. Second, only one member from each coset is 
assigned to central lattice points. 
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B. Defining the Cost Function for the Labeling Problem 

We will treat the asymmetric problem where the individual descriptions are weighted and the distortions 
due to reception of subsets of descriptions are also weighted. There are in general several ways of 
receiving k out of n descriptions. Let £( n > re ) denote an index set consisting of all possible k combinations 
out of {0, ... ,n — 1} so that |£( n,K )| = (™). For example, for n = 3 and k = 2 we have £( 3,2 ) = 
{{0, 1}, {0, 2}, {1, 2}}. Furthermore, let < /ij G M be the weight for the ith description. 

Recall that a takes a single vector A c and maps it to a set of vectors {Aj},2 = 0, ... ,n — 1, where 
Aj G Aj. The mapping is invertible so that we have A c = a _1 (Ao, • • • , A n _i). Thus, if all n descriptions 
are received we reconstruct using the inverse map a -1 and obtain A c . If no descriptions are received, we 
reconstruct using the statistical mean of the source. In all other cases, we reconstruct using a weighted 
average of the received elements. 

We define the reconstruction formula when receiving the set of k out of n descriptions indexed by 
I € to be 



K ^ ^ 



(5) 



i<=e 



where 1 < k < n and where A c = Q\ c (x), i.e. x is quantized to A c G A c . The distortion dt due to 
approximating x by xg is then given by 



di 



- V y UiOi{\ c 



and the expected distortion with respect to X is given by = Ec^. 
Lemma 1 ( /I72l/): For any 1 < k < n, i G £( n K ), asymptotically as v c 

2 



(6) 



and independently of a 



D f 



E 

AeSAc 



Vo(Ac) 



fx{x) \\X - A c || dx 



E 

a c ga c 



14 (A c ) 



c inai(\ c 



(V) 



dx. 



Proof: The lemma was proved in [12] for the symmetric case and two descriptions. The extension 
to the asymmetric case and n descriptions is straight forward. See ||36l for details. ■ 
Notice that only the second term of (O is affected by the labeling function. We will make use of this 
fact and therefore define 



Dp 



- y~l mai(\ c ) 



(8) 



The cost function to be minimized by the labeling function must take into account the entire set of 
distortions due to reconstructing from different subsets of descriptions. With this in mind, we combine 
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71-1 



n— 3 7i— 2 Ti—l 
i=0 i=i+l fe=j+l 



A c - ^aj(A c ) 



2 Ti—2 n— 1 



i=0 j=i+l 



H > dx. 



(9) 



the distortions through a set of scalar (Lagrangian) weights. Specifically, let 7; £ I,f £ ^ e t ^ e 

weight for the distortion due to reconstructing using the set of descriptions indexed by L With this, 
we define the cost function J n for the n-description labeling problem to be given by (O (see top of next 
page), which can be written more compactly as 



71-1 



J n = £ / fx(x)J2 E ^ dx - 



(10) 



For example, using the fact that Aj = «i(A c ), we can write J n for the n = 3 case as 



^= e r /-(-)E 

A c£ A c -^(M i= 



7< 



A c — MiAj 



/ijAj + /ij Aj 



dx. 



i=0 

+ £ / /^wE £ t*j x < 

\ c eA c Jv "( x ^ i=o j=i+i 

Since we are considering the high-resolution regime, we can make the following simplifications 

71—1 „ 

jn= E E E "?* I fx(x)D e dx (11) 



'Va(Xo) 
71-1 

E p(x g K(A C )) E E ^ 



A c eA c 



K=ite£<"-»> 



n—l 



E P( * V''*"" E E E 



a^ga„ 



(12) 
(13) 



n-l 



A c eV^(A„) k=1£ G £(™.«) 

= w E E E « 04) 

77 A e eK(0) k=1£ G £<".~) 

where P(X G V^(A C )) is the probability that X will be mapped (or quantized) to A c . The approximation 
follows by substituting P(X G Vc(A c )) ~ P(X G V^(An-))/iV T for A,,- G which becomes exact as 

— )• 0. In ( [TBI , we also exploited that a is shift invariant in order to decompose the sum YJ A gA into 
the double sum Y^ A eA Y^ A g y ^ A s as follows from ©. 

We would like to simplify J n even further. In order to do so, we introduce the following notation. 
Let llf ,rC) indicate the set of all £ G that contains the index i, i.e., cf' n) = {£ G £( n ' K ) : 
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i G £}. Similarly, 6^ k) = {£ G :i,je £}. Moreover, let j(C^) = £ l6jC c„,*) it, l{cf" K) ) 



T^iec'"^ ^ and 7(£jj ) = 12e e ci n -^ ll ' Thus '7(^ (3,2) ) = 70,1+70,2+71,2 &ndi(C\ ' ') = 70,1+71,2- 
Theorem 1: Let 1 < k < n < 00. Given a set of distortion weig K < 

n — 1}, a set of description weights {0 < /i, G K : i = 0, . . . , n — 1} and any A c G A c we have 



n— 2 n— 1 



2 7^£ = X) W 



(n,K) 
3 



+ 7(£ ( "' K) ; 



i=0 j=i+l 



_. n— 1 



(15) 



K7(£(»»«)) 



i=0 



where A, = aj(A c ) and 



7 



(n,re) 



1 /7(A (n * K) )7(A' w ) 



(n,re)s 



(16) 



K 2 I 7(£(n,«)) 

Proof: See Appendix lAl ■ 

From (fT3T > we make the observation that whenever Aj appears, it is multiplied by /ij. Without loss of 

generality, we can therefore scale the lattice Aj by Uj and consider the scaled lattice Aj = /UjAj instead. 

This simplifies the notation. For example, i,t = \ J2iee ^* where Aj = /ijAj for i = 0, . . . , n— 1. Clearly, 

scaling the sublattices affects the side description rates. We address this issue in Section IIII-EI 

By use of Theorem Q] we can rewrite the cost function to be minimized by the labeling function as 

_ _ _ 2 

jn 



1 n— 1 f n—2 n—1 

w E E EE tf 

n A c 6V;(0)k=1 k i=0j=i+l 



Aj — Aj 



+ 7(£ 



(n,re) •> 



^£^)* } 



(17) 



where 7^ is given by (fT6l) . 



The following theorem allows us to simplify the construction of the labeling function: 
Theorem 2: Let 1 < n G N. The cost function J n is asymptotically separable in the sense that, as 
Aj — > 00 and z/j — > 0, Vi, an optimal set 7"* of A^ distinct and shift invariant n-tuples satisfies 



n— In— 2 n—1 



E EE E 



~ (n,/i) 



7 



7^ = argmm ^ ^ <<,, 

(A ,...,A„_i)GT k=1 i=0 j=i+l 



Aj — Ao 



(18) 



where 7" = {(Aq, • • • , A n _i) G Aq x • • • x A n _i : (Aq, • • • , A n _i) is shift invariant}, |T| = N w and where 



~ (n,re) 
7i,j 



is given by ( fl6l ). 



Proof: See Appendix IB1 ■ 
Theorem |2] provides a guideline for the construction of n-tuples. One should first find a set of N v 
distinct and shift invariant n-tuples which satisfies ( fT8l ). These n-tuples (or members of their cosets) 
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should then be assigned to central lattice points in K-(O) such that 



A c ev;(o) «=i 

is minimized. 



n—l 1 n— 1 

E E ^-^mjE^'ja, 



2 



(19) 



Remark 1: Notice that we have not claimed that T* is unique. Thus, there might be several sets of 
n-tuples which all satisfy (TT8T ) but yield different distortions when inserted in (TT9l . However, Theorem |2] 
states that the asymptotically (as Ni — > oo) dominating distortion is due to that of (fT8l ). Thus, any set of 
n-tuples satisfying (fT8l ) will be asymptotically optimal. Interestingly, we show in Section IIII-DI that T* 
is, in certain cases, indeed asymptotically unique (up to translations by coset members). 

C. Constructing n-Tuples 

In order to construct n-tuples which are shift invariant we extend the technique previously proposed 
for the symmetric n-description MD problem lfl3l . 

We first center a sphere V at all sublattice points Ao £ K-(O) and construct n-tuples by combining 
sublattice points from the other sublattices (i.e. Aj,i = 1, ... ,n — 1) within V{\q) in all possible ways 
and select the ones that minimize (TT8T ). For each Ao € V n (0) it is possible to construct N n-tuples, 

where N is the number of sublattice points from the ith sublattice within the region V. This gives a total 
of (N n /No) YYl=i Ni n-tuples when all Ao € V n (0) are used. The number Ni of lattice points within V 
may be approximated by Ni « v jvi where v is the volume of y[] 

Since Ni « v jivNi) and we need A^o n-tuples for each Ao G K-(O) we see that 

n—l ~n— 1 n—l 

i=l i=l 

so in order to obtain at least iVo n-tuples the volume of V must satisfy (asymptotically as Ni — > oo) 

n-l 

v>VcnNl l{n - 1] . (20) 

i=0 

For the symmetric case, i.e. N = Ni, % = 0, . . . , n — 1, we have v > i> c N n /( n ~ 1 \ which is in agreement 
with the results obtained in lfT3l . 

The design procedure can be outlined as follows: 

1) Center a sphere V at each Ao € V n (0) and construct all possible n-tuples (Ao, Ai, . . . , A n _i) where 
Aj G ^(Ao) and i = 1,... ,n— 1. This makes sure that all n-tuples have their first element (Ao) 
inside V^(0) and they are therefore shift-invariant. 

'This approximation becomes exact in the usual asymptotical sense of Ni — > oo and Vi — > 0. 
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2) Keep only n-tuples whose elements satisfy ||Aj — Aj|| 2 < r 2 /L,\/i,j G 0, ... n — 1, where r is the 
radius of V. 

3) Make V large enough so at least N distinct n-tuples are found for each Ao- 

The restriction ||Aj — Aj|| 2 < r 2 /L in step |2] above, is imposed to avoid bias towards any of the 
sublattices. At this point, one might wonder why we wish to avoid such bias. After all, the expression to 
be minimized, i.e. ( fT8T ), includes weights (which might not be equal) for every pair of sublattices. 

In otherwords, why not use spheres V{j of different sizes to guarantee that ||Aj — Aj|| 2 < rfj/L where 
the radius r« j now depends on the particular pair of sublattices under consideration. This is illustrated 
in Fig. [3] in Appendix IB] where ri j denotes the radius of the sphere Vij. Here we center Vo,i at some 
A G V n (0) as illustrated in Fig. [3] by the solid circle. Then, for any n-tuples having this Ao point as first 
element, we only include Ai points which are inside Vo,i(Ao). This guarantees that ||Ao — Ai|| 2 < Tq^/L. 
Let us now center a sphere V\p at some Ai which is inside Vb,i(Ao)- This is illustrated by the dotted 
sphere of radius r\$, in the figure. We then only include A2 points which are in the intersection of Vi,2(Ai) 
and Vo,2(Ao)- This guarantees that ||Aj — Aj|| 2 < r^j/L for all pairs. 

Clearly, the radius r^j must grow at the same rate for any pair so that, without loss of generality, 
?*o,i = 02^0,2 = 01^1,2 for some fixed ai,a2 G M. Interestingly, from Fig. [3] we see that ro,2 cannot be 
greater than ro,i + ri,2 which effectively upper bounds a% Thus, the ratio r^j/r^i cannot be arbitrary. 
Furthermore, it is important to see that the asymmetry in distortions between the descriptions, is not 
dictated by but instead by how the n-tuples are assigned to the central lattice points. Recall from (fT9l ) 
that the assignment is such that the distances between the central lattice points and the weighted centroids 
of the n-tuples are minimized. In other words, if we wish to reduce the distortion due to receiving 
description i, then we assign the n-tuples so that the ith element of the n-tuples is closer (on average) 
to the associated central lattice points. Obviously, the remaining elements of the n-tuples will then be 
further away from the assigned central lattice points. 

In the following we first consider the case where r = r^j for any We later show that this is 

indeed the optimal choice in the symmetric distortion case. It is trivially also optimal in the two-channel 

(2 1) 

asymmetric case, since there is only a single weight 7^ | .In general, we can always scale the radii such 
that 



n-1 





(A ,...,A„_i)eT «=i 



(21) 



n-1 



(A ,...,A„-i)<5T «=1 
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for any ^ (k,l) where T indicates the set of N n n-tuples and Ck,i £ M. The resulting distortions 
weights (as given by (|33T ) and (l34l l) should then include the additional set of scaling factors {c£,z}. This 
case is treated by Lemma |2l 

We now proceed to find the optimal u, i.e. the smallest volume which (asymptotically for large iVj) 
leads to exactly Nq tuples satisfying step[2j In order to do so, we adopt the approach of IPT31 and introduce 
a dimensionless expansion factor ip n> L- The expansion factor i^n^L describe how much V needs to be 
expanded (per dimension) from the theoretical lower bound (l20l ). to make sure that exactly Nq optimal 
n-tuples can be constructed by combining sublattice points within a region V. With this approach, we 
have that 

n-l 

*=<^n^ /(n-1) - (22) 

1=0 

In practice, it is straight-forward to determine ip n L- One can simply start at ip n L = 1 an d iteratively 
increase V>n,L in small steps until exactly Nq n-tuples are found which all satisfy ||A, — X 3 ;|| 2 < r/L. For 
volumes containing a large number of lattice points, i.e. asymptotically as iVj — > oo, such an approach 
determines ip nj L to arbitrary accuracy. Furthermore, in this asymptotical case, ifj n ,L becomes independent 
of the type of lattice (and also iVj), since it then only depends on the number of lattice points within a 
large volume. Thus, it should be clear that for any 1 < n £ N and 1 < L € N, and asymptotically as 
Ni — > oo,Vi, there exist a unique 1 < ip nj L £ 

In general, it is complicated to find an analytical expression for i/j^l- However, we have previously 
been able to do it for the symmetric MD problem in some interesting cases. It turns out that the proof 
technique and solutions provided for the symmetric case, carry over to the asymmetric case. To see this, 
we sketch the proof technique here for the asymmetric case and n = 3. 

Recall that we seek 3-tuples such that any two members of the 3-tuple is distanced no more than 
r 2 /L apart. Specifically, we require ||Aj — Aj|| 2 < r 2 /L where r is the radius of V. Essentially, this 
is a counting problem. We first center a sphere V at some Ao € V n (0) n Aq. Then we pick a single 
Ai G V"(Ao)n Ai. Finally, we center an equivalent sphere V at this Ai and count the number, say of 
A2 E V(\q) n V(Xi) n A2. Thus, there is #\ 1 3-tuples having the same pair (Ao, Ai) as first and second 
element. The procedure is now repeatedly applied for all Ai € V"(Ao) H Ai yielding the total number of 
3-tuples to be ^Ai6V - (A Q ) navm § the same Ao as first element). 

For large volumes, the number of lattice points in a region 5 is given by Vol(5)/i^ where Vol(5) 
is the volume of S and ^2 is the volume of the Voronoi cell of the sublattice points A2 G A2. Thus, 
given the pair (Aq,Ai), the number of A2 sublattice points is approximately given by Vol(5)/i>2 where 
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S = V"(Ao) H V(\i). It follows that we need to find the radius (or actually the volume v of V) such that 
5^AieVYAo) = ^ r °' srnce we nee d exactly No 3-tuples for each Ao G V w (0) n Ao. To find the optimal 
i>, we derive the volume of intersecting L-dimensional spheres distanced < b G R apart. We then let 
bk be a sequence of increasing distances which yields a sequence of volumes {Vol(S'fc)} of the partial 
intersections = V"(0) H V(bk). We finally form the equality Y?k=l i^s k ^ol(Sk)/i^2 = No where #s k 
denotes the number of times each Sk occurs. By solving for r, we find the unique volume v which leads 
to exactly Nq n-tuples. It can be shown that this procedure yields the optimal v and is asymptotically 
exact for large volumes. Furthermore, it is essentially equivalent to the symmetric case the only exception 
being that the index values forming the product (1221 are allowed to be different in the asymmetric case. 
We therefore refer the reader to 11131 . |[36l for the rigorous proof and quote some results below. 

In the case of n = 2, it trivially follows that tp2,L = 1 for all L. For the case of n = 3 and L odd we 
have the following theorem. 

Theorem 3 ( IU1\ Thm. 3.2]): Let n = 3. Asymptotically as N — > oo,Ui — > 0,Vi, ^3,L for L odd is 
given by 

^ L= (^f( L 4±t^ (23) 



where ojl denotes the volume of an L-dimensional unit-sphere and only depends on L and is given 
by 



L+1 L-l 



2 / L±l\ 2 { L+l \_ f l-L \_ 



(24) 



3=0 



J J \2 ) \AJ L + m + j 

where (-)k is the Pochhammer symbol^ ▲ 

Theorem 4 ( / Ti3l/ . Let n = 3. Asymptotically as N — > oo, Vi — > 0, Vi, and L — > oo 

^3,oo = (~\ 4 ■ (25) 

A 

Remark 2: The proposed construction also provides a shift invariant set of n-tuples in the non- 
asymptotical case where N is finite. Thus, the design is useful in practice. 

l0 The Pochhammer symbol is defined as (a)o = 1 and (a)h = a(a + 1) • • • (a + k — 1) for k > 1. 
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D. Assigning n-Tuples to Central Lattice Points 

At this point, we may assume that we have a set T containing N % shift invariant n-tuples. These 
n-tuples need to be assigned to the N w central lattice points within V^-(O). However, before doing so, we 
first construct the coset of each n-tuple of T ■ Recall that the coset of an n-tuple is given by (0]). 

As first observed by Diggavi et al. lfl4l . assignment of n-tuples (or more correctly cosets of re-tuples) 
to central lattice points, is a standard linear assignment problem where only one member from each 
coset is assigned. This guarantees that the labeling function is shift invariant. The cost measure to be 
minimized by the linear assignment problem is given by (fl9l ). Thus, the sum of distances between the 
weighted centroids of the n-tuples and the central lattice points should be minimized. 

Remark 3: Notice that we have shown that there exists a set of n-tuples and an assignment that 
satisfy the desired set of distortions. However, there might exist several assignments (for the same set 
of n-tuples) all yielding the same overall Lagrangian cost. Thus, in practice, when solving the bipartite 
matching problem one might need to search through the complete set of solutions (assignments) in order 
to find one that leads to the desired set of distortions. Alternatively, one can pick different solutions 
(assignments) and use each of them a certain amount of time so that on average the desired set of 
distortions are satisfied. 

Remark 4: It might appear that the shift invariance restriction enforced by using only one member 
from each coset will unfairly penalize Ao- However, the following theorems prove that, asymptotically 
as Ni — > oo, there is no bias towards any of the sublattices. We will consider here the case of n > 2 (for 
re = 2 we can use similar arguments as given in 1 14]). 

Theorem 5: Let n > 2. Asymptotically as Ni — > oo, Vi, the number of n-tuples that includes sublattice 
points outside K-(O) becomes negligible compared to the number of n-tuples which have all there 
sublattice points inside V w (0). 

Proof: See Appendix ICl ■ 

Theorem 6: Let n > 2. Asymptotically as N — > oo,Vi, the set of N n n-tuples that is constructed by 
centering V at each Ao G V^-(O) n Ao becomes identical to the set constructed by centering V at each 
Xi e 14(0) n Aj, where i E {1, . . . , n — 1}. 

Proof: See Appendix IT51 ■ 

Remark 5: Notice that the above theorems imply that the set of n-tuples which satisfies (fT8l ) and is 
constructed so that r^.,- = aijr, V(f,j) and aj jC G M L , is unique (at least up to translations by members 
of their cosets). The assignment of the n-tuples to central lattice points, however, might not be unique. 
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E. Description Rates 

The single-description rate R c , i.e. the rate of the central quantizer, is given by 

Rc=-tY<\I fx(x)dx) log 2 ( [ fx(x)dx) . 
L \^AyV c {A c ) J \Jv c (\a) J 

Using the fact that each Voronoi cell V c {\ c ) has identical volume v c and assuming that fx(%) is 

approximately constant over Voronoi cells of the central lattice A c , it can be shown that 11331 



R c ^hi{X)-^\og 2 {v c ), (26) 

where h(X) is the differential entropy of a source vector and the approximation becomes asymptotically 
exact in the high resolution limit where v c — > 0. 

The side descriptions are based on a coarser lattice obtained by scaling the Voronoi cells of the central 
lattice by a factor of AjyUj. Assuming the pdf of X is roughly constant within a sublattice cell, the rates 
of the side descriptions are given by 

Ri « jh(X) - 1 log 2 (AT iW i/ c ) (27) 

where the approximation becomes exact asymptotically as Niv c = i>i — > for a fixed weight < /ij G M. 
The description rates are related to the single-description rate by 

Ri sa R c - -log 2 (Ai/ii). 

It follows that, given description rates Ri and description weights fa for i = 0, . . . ,n — 1, the index 
values are given by 

AT. = _L 2 h(X)-LR> (28) 

j_ 

and the nesting ratios by A 7 ! = . 
F. Distortions 

We now provide analytical expressions for the expected distortions in the case of n = 2 and n = 3 
descriptions. 

Theorem 7: Let n = 2 and 1 < L G N. Furthermore, fix the weights < /ij G 1 and 7, G R where 
i = 0, 1. Given an optimal labeling function a, then, asymptotically as Ni — > 00 and — )• 0, the expected 
distortion Z)j = E|| X — Xi\\ 2 where X{ = fa\ satisfies 

A = 7 l, , 2 g(^)^ c 2/z '(AroAr 1 ) 2 ^( / ioMi) 2/£ (29) 



(70 + 71) 



7: 



2 



(70 + 71) 



r C7(S L )2^W2 2 ^-^+^ (30) 
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where i,j G {0, 1} and i ^ j. 

Proof: Follows by applying the proof technique of Diggavi et al. lfl4l and using the fact that we are 
here optimizing over L-dimensional spheres rather than Voronoi cells as was the case in Ifl4ll . ■ 
Theorem 8: Let n = 3 and 1 < L G N. Given the set of distortion weig hts {j e G R : i G £( n < K ),l < 
k < n — 1}, and set of description weights {0 < m G R : i = 0, . . . , n — 1} and an optimal labeling 
function a. Then, for any 1 < k < n, any I G £( n ft ), and asymptotically as N{ — > oo and Vi — > 0, the 
expected distortion Di = E\\X — Xi\\ 2 where Xi = is given by 

D t = i t $ L G(S L )$ L (ji v 1 to) 1/L (N N 1 N 2 ) 1 ' L (31) 
= ^ L G{S L )2T KX) 2 Rc-(Ro+Rr+R a ) (32) 

where the weights G R for k = 1 is given by 

7] + 7* + Ijlk 
(7o + 7i + I2Y 

and for k = 2 by 

17^ + 7^ + 7^7^ 

7*>i = 77^ — T ^2 ( 34 ) 

4 (70,1 +70,2 +7i,2r 

where k ^ i,k ^ j, and j / i and <I>l = ^j^j^^Il wnere ^3,i i s given by (l23l) . /3l is given by (l24l ) 
and 

2 /L+l\ 2 /L+l\ /1-Ly 

/ \ n k±k- m , -,\mST^ \ 2 / fc V > k 



m=0 V 7 fc=0 ^ 2 /fc ( . 35) 

X § G) (2) ( ~ iy (i) L + m + j + 2" 

Proof: See Appendix IE] ■ 

For large L, we can simplify the term ^ appearing in Theorem [U which we for later reference put 
into the following corollary: 

Corollary 1: Asymptotically as Ni — > 00 and L — >• 00, 3>z, = (|) 2 - ^ 
If we in the construction of the n-tuples use the additional set of weights {cjj} as given by (|2~TI ). then 
7^ is given by the following lemma: 
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Lemma 2: For any n > 1,1 < k < n and £ G £( n > K ) we have 



It 



7(£(«.«))2 re 2 



n— 1 



_^ (£ (n,.) )2 g g ^ (36) 

i=0 j'=i+l 
n— 2 n—1 \ 

-EE 7(4 n ' K) )7(4 n ' K) )^- 

i=0 j=i+l ' 

where if Cjj = 1 and n = 3, d36l ) reduces to d33l and d34l) for k = 1 and k = 2, respectively. 

Proof: Follows by inserting the additional weights {cij} in (1771) . ■ 
Notice also that, for any n > 1 and asymptotically as v c — > 0, the expected central distortion is trivially 
given by 

D c = ED C = E\\X - Q Ac (X)\\ 2 = G(A c )iy 2 J L . (37) 

We end this section by establishing an interesting result for the n-channel IA based MD problem. 

Corollary 2: Let n > 1 and 1 < L < oo. Given the set of distortion weig 
k < n — 1}, and set of description weights {0 < ^ G 1 : i = 0, ...,n - 1} and an optimal labeling 
function a. Then, for any 1 < k < n, any £ G c( n < K ) f and asymptotically as Ni — > oo and Vi — > 0, 
the expected distortion Dg = E\\X — Xg}\ 2 where Xp = 2~2 i( zg HiXi is linearly proportional to where 
£' G : 1 < k < n}. In particular 

Dp = ^ c , 2 rM^) 2 ^T(^-E^ 1 «0 (38) 



where 7^ is given by (1361) and < eg < oo,\/£. 

Proof: Follows from the proof of Theorem [8] ■ 
Remark 6: We have not been able to find the set of constants {cp\ in (|38T ) for the case of n > 3. 
However, since < q < 00 it follows that, for any n > 1, the side distortions for different subsets of 
descriptions are linearly related, independently of the description rates. This observation has an interesting 
consequence. Let the growth of N n = J^[ i N{ as a function of the rates be given by N w = 2M«-i)£ I ft 
where < a < 1. Moreover, since Rj = R c — ~log 2 (iVi) we also have that N w = 2 L ( nRc ~^ ■ R *). 
Equating the two expressions for and solving for R c yields R c = — 2~2i Ri(a(n — 1) + 1). Inserting 
this into (I38T ) and (l37l leads to 

lim D < 25ME,ii. =c /2W (39) 

£\ -Ri-s-oo 
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for any I £ £( n ' K ) and 



lim L> c 2w( 1 +«("- 1 ))^^ 




(40) 



where d € R depends on £, c € R is independent of £ and a controls the rate trade-offs between the 
central and the side descriptions. Thus, the product of the central distortion D c (l40l and an arbitrary set 
of (n — 1) side distortions Di (l39l ) is independent of a. This observation agrees with the symmetric 
n-channel product considered in ll37l . 

IV. Comparison to Existing Schemes 

We first assess the two-channel performance. This is interesting partly because it is the only case where 
the complete achievable MD rate-distortion region is known and partly because it makes it possible to 
compare the performance to that of existing schemes. 

A. Two-Channel Performance 

The side distortions D' and D' x of the two-channel asymmetric MD-LVQ system presented in |[T4l 
satisfy (under identical asymptotical conditions as that of the proposed design) 



where i,j G {0, 1} and i ^ j and the central distortion is given by D' c » G(A C )2 2 W X )- R -). Notice that 
the only difference between (|4~TT) and d30b is that the former depends on G(A n ) and the latter on G(Sl). 
For the two dimensional case it is known that G(S2) = 1/(4tt) whereas if A,,- is similar to Z 2 we have 
G(A,r) = 1/12 which is approximately 0.2 dB worse than G^S^)- Fig. [T] shows the performance when 
quantizing 2 • 10 6 zero-mean unit-variance independent Gaussian vectors constructed by blocking an i.i.d. 
scalar Gaussian process into two-dimensional vectors and using the Z 2 quantizer for the design of |[T4l 
as well as for the proposed system. In this setup we have fixed i?o = 5 bit/dim. but R± is varied in the 
range 5 - 5.45 bit/dim. We have fixed the ratio 70/71 = 1.55 and we keep the side distortions fixed and 
change the central distortion. Since the central distortion is the same for the two schemes we have not 
shown it. Notice that Dq (resp. D\) is strictly smaller (about 0.2 dB) than D' (resp. D^). 

B. Three Channel Performance 

In this section we compare the rate-distortion properties of the proposed design to the inner bound 
provided in Q, (H. Thus, we restrict attention to the symmetric case. In order to do this, we first define 
an MD distortion product for the three channel case. Then, we show that by random binning one can 



(70 + 7i) 2 




G(A 7r )2 2h(x) 2~ 2(/?0+jRl "' R<:) 



(41) 
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Fig. 1. The side distortions are here kept fixed as the rate is increased. Notice that the numerically obtained side distortions 
Dq and D\ are strictly smaller than the theoretical D' and D[. 



further reduce the description rates. Finally, we assess the rate loss when finite-dimensional quantizers 
are used but no binning. 

1) Three Channel Distortion Product: To assess the performance of the three channel design it is 
convenient to define the distortion product D w which in the symmetric distortion case (i.e. for Dq = 
D\ = D2 and Z)o,i = flo,2 = ^1,2) takes the form D 71 = D c DiDij. This is similar in spirit to 
Vaishampayan's widely used symmetric two-channel distortion product ll38l . 

Let n = 3 and consider the symmetric case where ^ = 1,7, = c\ and %j = C2 for i,j = 0, 1,2 
where ci , C2 are some constants. Moreover, R4 = R and JVj = N for i = 0, 1, 2. It follows from ( f33T > that 
7i = 5 and from (l34l ) that jij = ^ so that by (l32l) we see that the one-channel distortion is given by 



Di = U L G(S L )2i h W+ R c- 3R 
3 

and the two-channel distortion is given by 

fly = l$ i G(5 i )2*^)+^- 3fi . 
We also recall that the central distortion is given by 

D c = G(A c )2T h ^)- 2 ^. 
This leads to the following distortion product 



D* = L<s>l G{ s L fG{k c )2T h W-™ 
6b 



(42) 



(43) 



(44) 



(45) 



which is independent of R c and only depends upon the description rate R. 
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Recall that in the Gaussian case, h(X) = |f 
l/(2vre) and (by Corollary Q} = § so tha 




(46) 



The following lemma shows that the proposed design is able to achieve a distortion product based on 
the inner bound of Q, 0. 

Lemma 3: The high-resolution distortion product D 77 of the three-channel achievable quadratic Gaus- 
sian rate-distortion region of Pradhan et al. Q, (H is identical to (l46l ). 



Remark 7: Thus, for any rate trade-offs between central and side descriptions, the distortion product 
of the proposed MDLVQ achieves a distortion product based on the inner bound of Q, (H. This inner 
bound is not always tight as shown in |39l . However, in the case where we are only interested in the one- 
channel distortion Di and the central distortion D c , optimality was recently proven in [37]. In particular, 
independently of our work, [37 ] proposed a distortion product based on the outer bound of 0. Moreover, 
it was shown that in the three-channel case, the product DfD c of our MDLVQ construction achieves the 
distortion product of IT371 . We show next that in the case where we are only interested in the two-channel 
distortion Di j and the central distortion D c , we are in fact also optimal. 

2) Random Binning on the Labeling Function: It was shown in (71 , (8] that the achievable rate region 
can be enlarged by using random binning arguments on the random codebooks. Interestingly, we can 
show that it also makes sense to apply random binning on the labeling function proposed in this work. For 
example, in the case of three descriptions, we can utilize the universality of random binning so that one 
can faithfully decode on reception of e.g. at least two of the three descriptions. With such a strategy, it is 
then possible to reduce the effective description rate, since the binning rate is smaller than the codebook 
rate. The price to pay is that one cannot faithfully decode if e.g. only a single description is received. 

In order to understand how we apply random binning on the labeling function, recall that every \ G Aj 
is combined with the set of Aj's given by 7}(Aj) = {Aj G Aj : Aj = aj(A c ), Xj = aj(\ c ), A c G A c }. The 
trick is now to randomly assign members of Tj(Xi) to a set of bins in such a way that it is very unlikely 
that two or more members of Tj(Xi) fall into the same bin. When encoding, we first apply the central 
quantizer Qa c on the source variable X in order to obtain the central lattice point A c = Qa c (X). We 
then map the given A c to the triplet (Ao,Ai,A2) = a(X c ). We finally find and transmit the bin indices 
of Aj, i = 0, 1, 2, rather than their codebook indices. On reception of at least (any) two bin indices, we 
search through all the elements in the two bins in order to find a pair of sublattice points which are 



Proof: See Appendix [F] 
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elements of the same n-tuple. If the binning rate is large enough, there will (with high probability) be 
only one such pair of sublattice points for any two bin indices. 

Theorem 9: Let n = 3 and let a be an optimal labeling function. Moreover, assume we apply random 
binning on the labeling function such that one can faithfully (and uniquely) decode on reception of any 
two descriptions. Then, asymptotically, as iVj — > oo,fj — > 0, and L — > oo, the binning rate R b must 
satisfy 

R b > \R+\log 2 ^, L yfW>) (47) 

where R is the description rate. 

Proof: The proof is essentially similar to the technique presented in Elllll ■ 
We can further show that the binning rate, as given by d47l) . coincide with that of Q for this particular 
case where we can only decode on reception of at least two out of three descriptions. To show this, note 
that when we get arbitrarily close to the binning rate in (|47"T ). it follows that 

R = 2R b - X - log 2 (^ 3 2 L) " I log 2 (iV'). (48) 



In this case, the two-channel distortion Dij, as given by (1431 ). can be written as 

Di,j = ^ L G{S L )2^ X )2 R ^ R 



12 



(c) (N')\ lA n -4R 



12 

where (a) is valid for (unit-variance) Gaussian sources, in the limit as L — > oo so that = ^1 oo anc ^ 
2T h ( x ) = G(Sl)- 1 . (b) follows since R c = R + log 2 (N') and (c) follows by inserting ([48]>. Similarly, 
in the limit as L — > oo, the three-channel distortion (central distortion D c ) is given by 



D c = 2- Rc (50) 
1 



2~ iR \ (51) 



On the other hand, from 0, see also Appendix 10 it follows that the two-channel distortion D[ ■ of 
Pradhan et al., is given by 

D' itj = ^a 2 q (l + p) (52) 

"The complete proof for the asymmetric case can be found in 1361 . 
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where p is defined in Appendix |F] and 

a\ = 2(1 - p)- l l\l + 2 P r 2 ^ 4R \ (53) 
Moreover, the three-channel distortion D f - ■ . is given by 



D' id , k = -a 2 q (l + 2p). (54) 



Let us equate the pair of two-channel distortions, i.e. Dij = D[ ■, from which we obtain 

(l + 2p) 1/3 = ( ^3 4 oo(^) 2 V 1/2 (1 + p) 1/2 (1-p)- 1/6 . (55) 



12 

Inserting ((55]) and (O into ([54]) yields 



Di^ = |(^<«,(jV) 2 )"" (l+rt 1/2 (l-p)- 1/2 2-" ! - (56) 



^(l) VlH ' 

where the last equality follows by inserting ipzoo = (f ) 2 anc ^ letting /? — > — ^, which corresponds to 
the asymptotical case where N' — > oo. It follows that the resulting two and three-channel distortions are 
identical (the ratio of (f5TT > and (1571 ) is one) for the the proposed design and the bounds of Pradhan et 
al. Q. 

3) Rate Loss: Let us define a rate loss for the symmetric case as R\ 0fiS = R — R mn (per description), 
where i? inn denotes the rate obtained from the inner bound of Pradhan et al. With this, the rate loss can 
easily be derived from the distortion product by isolating the rates in (l45l ) and (l46l ) and forming their 
difference, that is 



^Rloss = ilog 2 ($!) + ilog 2 (J 

+ Uog 2 {G{S L ) 2 G(K){2iref) 



(58) 



which clearly goes to zero for large L since = |. With this definition of rate loss, the scalar rate loss 
(i.e. for L = 1) is i? loss = 0.2358 bit/dim. whereas for L = 3 and using the BCC lattice, the rate loss is 
0.1681 bit/dim. Furthermore, we have numerically evaluated the terms log 2 (G(5L)27re) and log 2 ( < I ) ^|) 
for 1 < L < 21 (and L odd) as shown in Fig. |2] It may be noticed that log 2 (<I>||) is strictly smaller than 
log 2 (G(5i)27re). It follows that, at least for this range of dimensions, the overall description rate loss, 
as given by (I58T ). is less than the space-filling loss of the lattice in question. This is in contrast to, for 
example, the MD scheme presented in [16 ] where the description rate loss is larger than the space-filling 
loss of the lattices being used. At high dimensions, the rate loss vanishes for both schemes. 
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Fig. 2. The terms log 2 (G , (5 , L)27re) and log 2 ("l>i|) as a function of the dimension L. Both terms converge to in the limit 
as L — > oo. Notice that log 2 (G(Sx)27re) > log 2 ($i|) in the range shown. 



V. Conclusions 

We proposed a simple method for constructing IA based n-channel asymmetric MD-LVQ schemes. 
For the class of IA based schemes using a single IA function and averaging reconstruction rules, the 
design was shown to be asymptotical optimal for any number of descriptions. For two descriptions, the 
rate loss was smaller than that of existing IA based designs whereas for three descriptions, the rate 
loss (when compared to the inner-bound of Pradhan et al. and restricted to the case of symmetric rates 
and distortions) was smaller than that of source splitting. It was finally shown that the rate-distortion 
performance achieves points on the inner bound proposed by Pradhan et al. 

Appendix A 
Proof of Theorem Q] 

To prove Theorem [T] we need the following results. 

Lemma 4: For 1 < k < n and any i G {0, . . . , n — 1} we have 

rt-l 

^7(4"' K) ) = ^(^ K) )-7(A ( "' K) )- 

3=0 

Proof: Since |£^™' K ^| = the sum Y^=o liAj ) cont ains n(™~|) terms. However, the number 

of distinct terms is |£( n,K )| = (") and each term is then used k times, since 

<--[) 

C) 



K. 
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Subtracting the terms for j = i proves the lemma. ■ 
Lemma 5: For 1 < k < n and any i, j € {0, . . . , n — 1} we have 

n— 1 
3=0 

Proof: It is true that £%> k) = cf' K) and since |£ 4 {n ' K) | = and \C ( ^ r) \ = (^) the sum 

E"=o 7( £ Sj K) ) contains (n - l)^! 2 .) + ("-!) terms - However » the number of distinct / G ' k) terms 
is |£^ n ' K ' ) | = ("ij) and each term is then used k times, since 



K) 

Lemma 6: For 1 < k < n we have 



= K. 



n-1 



2 7/( a c ,£a, Wa c ,£a,70C 

£ e £(",») \ iee / \ i=o I 
Proof: Follows immediately since £[ n ' K ^ denotes the set of all ^-terms that contains the index i. 
Lemma 7: For 1 < k < n we have 

n— 2 n—1 



E E 7(4 n ' K) )7(4 n,K) )ii^- A ,n 2 



j=0 .7=1+1 
n-1 



E7(A (n ' K) )(^ (£(n ' K)) -^ (£ S n ' K)) ) 
i=0 

n— 2 n—l 

-2E E 7(A (n ' K) )7(4 n,K) )^'^)- 

j=0 J=Z+1 

Proof: We have that 

E E ^c^mc^nxi-xjf 

i=0 j=i+l 

= E E 7(4 n ' K) )7(4 nA) )(ii^ii 2 + ii^-ii 2 ) 

i=0 j'=i+l 
n— 2 n—l 

-2E E 7(A (n,K) )7(4 n,K) )^'^)- 

i=0 j=i+i 

Furthermore, it follows that 

n—1 n—l 

E E 7(4" a) )7(4" a) )(ii^ii 2 + ii^ii 2 ) 

i=0 j'=i+l 



n— 2 n—1 

•("- k )mi\.ii2 \" ^irJP' K )\ 

i=0 j'=i+l 



= E7(4"' k) )iia,ii 2 E 7(4 
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n-1 i-1 
+ ^7(4 n ' K) )l|A,|| 2 j:7(A (n ' K) ) 

j=l i=0 
n—1 n—1 

= ^7(A (n ' K) )iiA,n 2 E t(4" ,k) ) 

i=0 j'=i+l 



for i=n—l 



n-1 j'-l 

+ E7(4"' K) )l|A,|| 2 E7(A (ri ' K) ) 

j=0 8=0 



for j=0 



n—1 / i— 1 n—1 

=E^4 n " t) )iwi 2 E^4 n "V E ^4 n,K) ) 

i=0 \j=0 j=i+l 

n—1 n—1 

= E7(A (n ' K) )iiA,ii 2 E^4 n,K) ) 

i=0 j=0 

n-1 

= E^ n ' K) )l|A i || 2 («7(>C^)-7(4 n '' t) )) ) 

i=0 

where the last equality follows by use of Lemma |4] 
Lemma 8: For 1 < k < n we have 

n— 2 n—1 n—1 

E E 7(4^)^- H 2 = ^-^)Y,^ c t ,R) 

i=0 j=i+l i=0 

n— 2 n—1 

-2E E 7(4r } )( A ^i) 

i=0 j=i+l 

Proof: We have that 

n— 2 n—1 
i=0 j=i+l 

n— 2 n—1 

=E E ^r^iwi'+iNi 2 ) 

i=0 j=i+l 
n— 2 n—1 

-2E E 7(4r } )( A ^i)- 

1=0 i=i+l 

Furthermore, it follows that 

n-2 n-1 

e E ^r^ii^ii'+ii^n 2 ) 

i=0 j=i+l 

n—2 n—1 n—2 n—1 

=e e ^s^i^f+E e 7(4r ) )ii^ii 2 

j=0 j=i+l i=0 j'=i+l 
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ra-2 

Ei 

i=0 j=i+l 
n-1 



n— 1 ri—1 J— 1 

2 E ^rVEE^r^iwi 2 

j=l i=0 
n-1 j-1 

(n,/c) \ 



n-1 

em 2 E ^tveini'E^: 

i=0 j=i+l j=0 i=0 



for i=n—l 



for 3=0 



n-1 



=E 

i=0 
n-1 

=E 

i=0 
n-1 

( ='E 



i— 1 n— 1 

.j=0 j=i+l 



'n-1 



E7(4r } )-7(>c 



«7(4 n,K) )-7(4 n ' K) : 



(n,fc) 



t=0 



n-1 

= (.-l)^||A,|| 2 7(A ( "' K) ), 

i=0 

where (a) follows by use of Lemma [5] 
Lemma 9: For 1 < k < n we have 

2 



E 7£ 

£ g £(„,«) 



E^ 



n-1 



i=0 

n— 2 n— 1 



(n,re) 



-EE 7(4r)H^- A iii 2 - 

i=0 j=i+l 

Proof: The set of all elements £ of £( n > K ) that contains the index i is denoted by C^ n ' K \ Similar the 
set of all elements that contains the indices i and j is denoted by . From this we see that 

2 



E 7* 



E^ 



iec 



E 7,(eh^ii 2 + 2 E 

ieC( n '«) \iee i=0j=t+i 

n—l n— 2 n— 1 

^7(4 n ' K) )l|A i || 2 + 2E E 7(4r } )( A - A i)- 

i=0 i=0 j=i+l 
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By use of Lemma [8] it follows that 



E n 



E A - 



n-l 



n-l 



E^ 



(n,ft) 



i=0 



(ti,k) 



n—2 n—l 

2 -E E 7(4r ) )ii^- A 

i=0 j=i+l 

n—l n—2 n—l 

(n,«)si|» ii2 =r,( r( n > K )\l\ \ - \ Il2 



=0 



= ^7(C' k) )iia 1 ii 2 -E E 7(4r)n^- A 

i=0 i=0 j=i+l 

We are now in a position to prove the following result: 
Lemma 10: For 1 < k < n we have 



E ^ 



iG^ 



n—2 n-l / - / r (n,K)\ - i r {n,K) 



+iE E 



j=0j=i+l v ' v ' 7 

Proof: Expansion of the norm on the left-hand-side in (l59l ) leads to 

1 2 

E 7* A c--E A * 



= E 7,fl|A c || 2 -2(A c ,i^AA + i 2 
I 1 n_1 

{ = ) 7(£(^))||A c || 2 -2(A c ,i^7(4 nA) )A l 



E A? 

iG^ 



i=0 



+ 4 E 

£g£' 



7* 



E A) 



iee 



n-l 



^tE^m, 



k7(£(™.«0) / 



i=Q 



K 2 7(£(«. K )) 



n-l 



E7(4 nA) )A 



i=0 



+ E -2 



Ea. 



7 



n-l 



i=Q 



+ E 



IE 



E A' 

iG^ 



1 / n_1 



(n,«)\2 
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n— 2 n— 1 



+ 2 E E 7(4 n,K) )7(4"' K) )<^ 

i=0 j=i+l 



= 7(/: ( "' K) ) 



1 n— 1 



-. 71—1 



i=0 
n— 2 71—1 



^EE^r^-^i 



i=0 



t=0 j=i+l 



_. n— 1 

i V^f£ {n ' K) ) 2 |IA,-|| 2 



ft 2 7(£("' re )) 



i=0 



Ti-2 n-1 -/ r (nA)^c r (n,«)\ 
, V \" I j ' II \ _ \ ||2 

i=0 j=i+l IK ' 



n-1 



l — ^7(A (n ' K) )(-7(/: ( "' K) ) - 7(4 n ' K) ))IMI 2 



i=0 



7(£ (n ' K) ) 



n-1 



A, 



-J^g7(A ( "' K) )A, 
+ J_ g g ^7(4"' K) )7(4 n ' K) ) _ ^,(7i lK) 



i=o j=i+r- ,v ; 



T(rVrO)[|Ai-A 



VII ! 



where (a) follows by use of Lemma [6] and (b) by use of Lemmas [7] and [9] 



Appendix B 
Proof of Theorem [2] 



Without loss of generality, let ^ = l,Vi Furthermore, let 

n— In— 2 n— 1 



/= E EEE 



7 



(n,ft) 



A c eK(0) k=1 i=0 i=i+l 



A,; — A., 



and 



n-1 

>- E E 

A c ev„(o) «=i 



A,. 



1 n— 1 

^E^^A, 



i=0 



(60) 



(61) 



We prove the theorem by constructing a labeling function which lower bounds / independently of g. We 
then show that with this choice of / we have / — > oo and g — > oo but gj f — » as iVj — > oo, ^ — >• 0, Vi. 
Furthermore, we show that this holds for any admissible choice of g. Since = cq/ + ci<? for some 
constants cq,ci € R it follows that in order to minimize J n an optimal labeling function must jointly 
minimize / and g. However, a jointly optimal labeling function can never improve upon the lower bound 
on / which occur when / is independently minimized. Furthermore, g can only be reduced if taking 
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into account during the optimization. Thus, for any optimal labeling function we must have g/f — > 0. It 
follows that / is asymptotically dominating and therefore must be minimized in order to minimize J n . 

Let T denote the set of n-tuples assigned to central lattice points in V n (0) so that \T\ = N n and let 
% be the set of ith elements (i.e. a set of sublattice points all from Aj). Moreover, let T(Aj) be the set 
of n-tuples containing a specific Aj as the ith element. Finally, let Tj(Xi) be the set of Aj G Aj sublattice 
points which are the jth elements in the n-tuples that has the specific Aj as the ith element. With this, for 
any fixed Ao G %, the sum J2x 1 eTi(\ ) ~~ runs over tne set °^ ^ P orn ts which are hi the same 
n-tuples as the given Ao- Notice that this sum can be written as 5^Aie7;"(Ao) #a x II Ao — Ai|| 2 where the 
superscript u denotes the unique Ai elements of 71 (Ao) and #\ 1 denotes the number of times the given 
Ai is used. Clearly, this sum is minimized if the unique Ai points are as close as possible to the given 
Ao- In other words, for any given "distribution" {#Ai}, the sum is minimized if the Ai's are contained 
within the smallest possible sphere around Ao- In fact, this holds for any Ao G Tq. On the other hand, 
keeping the set of Ai's fixed we can also seek the minimizing distribution {#a 3 }- A good choice appears 
to be that the Aj points that are closer to the given Ao should be used more frequently than those further 
way. 

We pause to make the following observation. Due to the shift-invariance property of the labeling 
function, we can restrict attention to the n-tuples which are assigned to central lattice points within 
A 7r (0). Thus, we have a total of N w n-tuples. Recall that we guarantee the shift-invariance property by 
restricting Ao to be inside V w (0) (a restriction which we later relax by considering cosets). Furthermore, 
to avoid possible bias towards any Ao G K-(O), we require that each Ao is used an equal amount of times. 
Since there are N w /No distinct Ao points in K-(O) it follows that each Ao must be used Ao times. 

Let us for the moment being consider the case of n = 3, i.e. we need to construct a set of N w triplets 
T = {(Ao, Ai, A2)}. If we fix some Ao, we can construct a set of pairs of sublattice points by centering 
a sphere V at Ao and forming the set of distinct pairs S = {(Ao, Ai) : Ai G V{\q) n Ai}. For each pair 
(A , A^) G S we can form a triplet (A , A' l5 A2) by combining the given pair with some A2. It is important 
that A2 is close to A as well as X[ in order to reduce the distances ||A — A2 1 1 2 and HA^ — A2 1 1 2 - This 
can be done by guaranteeing that A2 G V(\q) and A2 G t^(Ai). In other words, A2 G V(Xq) n V^(Ai). 
With this strategy, fix some Ao G V^-(O) and start by using some "small" V in order to construct the 
set of pairs S = {(Ao,Ai) : Ai G V(\o) H Ai}. Then for each pair s G S we construct the set of 
triplets {(s, A2) : A2 G V(Xo) H V'(Ai)}. Recall that we need Ao triplets for each Ao- However, since V 
was chosen "small" we end up with too few triplets. The trick is now to increase the volume of V in 
small steps until we end up with exactly Ao triplets (keep in mind that for large Ao we work with large 
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Fig. 3. Different sizes of the spheres, 
volumes). 

In the n-description case, we require that A& G V^(Ao) fl V(Xi) D • • • Pi V(Xk-i)- If we let r be the 
radius of V, then with the above procedure it is guaranteed that ||Aj — Aj|| 2 < r 2 /L for all where 
i, j = 0, ... ,n- 1. 

Notice that /, i.e. the expression to be minimized as given by d60b , includes weights j^'^ (which 
might not be equal) for every pair of sublattices. In otherwords, we might use spheres Vij of different 
sizes to guarantee that [|Aj — Aj|| 2 < rfjL where the radius n t j now depends on the particular pair of 
sublattices under consideration. This is illustrated in Fig. [3] where r{j denotes the radius of the sphere 
Vij. Here we center Vo,i at some Ao G V^-(O) as illustrated in Fig. [3] by the solid circle. Then, for any 
re-tuples having this Ao point as first element, we only include Ai points which are inside Vo i(Aq). This 
guarantees that 1 1 Ao — Ai|| 2 < ro,i/L. Let us now center a sphere V\ : 2 at some Ai which is inside Vb,i(^o)- 
This is illustrated by the dotted sphere of radius n t 2 in the figure. We then only include A2 points which 
are in the intersection of Vi^Ai) and Vb,2(Ao)- This guarantees that ||A* — Aj|| 2 < r^jjL for all (i, j) 
pairs. Interestingly, from Fig. [3] we see that ro,2 cannot be greater than ro,i + ri^. Thus, the radius r^j 
must grow at the same rate for any pair so that, without loss of generality, 7*0,1 = 02^0,2 = 01^1.2 
for some fixed 01,02 G R. 

Recall that, the number iVj of lattice points of Aj within a connected region V of R L may be 
approximated by Ni where v is the volume of V. Moreover, the number of Ao points within V^-(O) 

is given by #\ w Vol(F 7r (0))/z/o = v c N^/vq. Since we need to construct a total of N n n-tuples to label 
the N n central lattice points, it follows that each Ao is used N 7r /^\ = Nq times. Let us now center a 
sphere V of volume v at some Ao G Ao- The number of \ points inside this sphere is asymptotically given 
by v jvi. Thus, the number of distinct n-tuples we can construct by forming all combinations of sublattice 
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points from Aj,i = l,...,n — 1 within V and using Ao as first element is given by v n ~ x / (Y]2=t v i)- 
Recall that we need Nq ra-tuples for each Ao- Thus, we obtain Nq = i) n ~ l v i) from which we 
see that the volume of the sphere V must satisfy 

71— 1 1 

v>VcY[Nr*. (62) 

»=o 

We previously argued that we need to make V large enough so as to be able to create exactly Nq n-tuples 
for each Ao which satisfy ||Aj — Aj|| 2 < r 2 /L. Having equality in (l62l guarantees that ||Ao — Aj|| 2 < r 2 /L 
for j = 1, ... ,n — 1 but then we must have [|Aj — Aj|| 2 > r 2 /L for some % ^ 0. However, since we 
are aiming at lower bounding / we may indeed proceed by assuming that ||Aj — Aj|| 2 < r 2 /L for all 
i. Furthermore, the different radii r^ j are related through a multiplicative constant which will not affect 
the rate of growth of the volumes of Vi t j as JVj — > oo. Thus, we proceed by assuming rjj = r so that 
Vi,J = v. 

We are now in a position to evaluate the following sum 

Aj675(A«) A,-67](0) 

= E # A ^ll A ill 2 - ( 64 ) 

Aj67?»(0) 

The volume of the sphere V is independent of which sublattice point it is centered at, so we may take 
Aj = from which (a) follows. Notice that for a fixed Ao and for n > 2, the set Tj(Xi) contains several 
identical Xj elements. We therefore use the notation 7J"(Aj) to indicate the unique set of Xj elements. 
Furthermore, we use the notation to indicate the number of times the given Xj is used. Since 
,627(0) #A 3 - No it follows that ^a 3 -6T/(o) mm j{#A 3 } < N so that minj{#A 3 } < No/X^er^o)- 
Moreover, \Xj S T"(0)| = v/vj which implies that Xa gT u (o) = ^/ v i anc ^ we therefore have that 
minjl^Xj} < NqUj/v. By similar reasoning it is easy to show that maxj{#> } > NqVj/D. 

We have previously shown that the intersection of any number of (large) spheres of equal radii r which 
are distanced no further apart than r, is positively bounded away from zero |[T3l . In fact, the volume of 
the smallest intersection can be lower bounded by the volume of a regular L-simplex having side lengths 
r lTT3ll . Recall that the volume Vol(S) of a regular L-simplex & with side length r is given by B01 

Vol(6) = ^y^ = c L r i (65) 

where cl is constant for fixed L. It follows that, in the three channel case, #\ 3 is lower bounded by 
clt /uh where is the volume of sublattice with the largest index value. Moreover, for n > 3 we have 
that is lower bounded by {clt l / Vf t ) n ~ 2 . 

December 2, 2010 DRAFT 



IEEE TRANSACTIONS ON INFORMATION THEORY, DECEMBER 2010 



34 



Interestingly, is obviously upper bounded by {oj lt l / Vki) n ~ 2 , i.e. ratio of the volume of an L- 
dimensional sphere of radius r and the volume of a Voronoi cell of where k' denotes the sublattice 
with the smallest index value. Notice that the lower bound is proportional to the upper bound and we 
have the following sandwhich 



Vk' 



> max{# Aj .} > NoVj/v 

3 



>min{# A .} > 

3 



"k 



L\ n-2 



(66) 



where the left and right hand sides of (1661 ) differ by a constant for any n which implies that there exists 
a positive constant c > such that mm.j{#\.} > cNgVj/u. 
Using the above in ( f64T > leads to 



MS 



(a) eTVji/ 



i"3 



\x\\ 2 dx 



= 2^!l LG{ s L y^ L 

V 

71— 1 2 

i=0 

where G{Sl) is the dimensionless normalized second moment of an L-dimensional hypersphere and 
(a) follows by replacing the sum by an integral (standard Riemann approximation). This approximations 
becomes exact asymptotically as Ni — > oo and V{ — > 0. 
We finally see that 



z E 



A c ev^(o) 



A,- - A, 



Ai67I A 3 e71(A,) 



I A« — Aj 1 1 2 



1 N. 



L N, 



IT \ ^ 

FT 



A,; — A, 



A.GTJCA.) 



n-1 



> cG(S L )N n u 2 J L H JV/- 1)X 



i=0 



so that 



71-1 



(67) 



i=0 



We now upper bound g. Notice that g describes the sum of distances between the central lattice points 
and the weighted average of their associated n-tuples. By construction, these weighted averages will 
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V*(0) 




Fig. 4. Kr(0) is a Voronoi cell of A*-. A is a scaled and centered version of T4(0) and B is the "strip" surrounding A, i.e., 
23 = 14(0) \ A 

be distributed evenly through-out (0). Thus, the distance of a central lattice point and the weighted 
average of its associated re-tuple can be upper bounded by the covering radius of the sublattice with the 
largest index value, say iV fe . This is a conservative upper bound but will do for the proof o The rate of 



growth of the covering radius of the kth sublattice is proportional to za 



l/L 



(N k u c ) 1 / L . Thus 



It follows that 



7- 



2/L 



e ( N k ^ 



(68) 



(69) 



where the last equality follows since the index values are growing at the same rate so that N{ = N^/h 

2 

for some constant b{ G R. The theorem is proved by noting that N k — >. as — > oo. ■ 



Appendix C 
Proof of Theorem [5] 

We restrict attention to the case where V^-(O) is the Voronoi cell of a product lattice generated by the 
approach outlined in Section Hl-BI In this case, the shape of V^-(O) can be either hyper cubic, or as the 
dimension increases, the shape can become more and more spherical. 

12 The worst case situation occur if the weighted centroids are distributed such that the minimal distance between any two 
centroids is maximized. Notice that the weighted centroids form convex combinations of the sublattice points. Since the weights 
are less than one, the worst case situation occurs if the weighted centroids are distributed on a lattice with an index value equal 
to the sublattice with the maximum index value (and therefore also the maximum covering radius). Thus, the bound is indeed 
valid for an arbitrary set of n-tuples and not tied to the specific construction of n-tuples used so far in the proof. 
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Let us first assume that that V w (0) forms a hyper cube having side lengths s as shown in Fig. [4] The 
n-tuples are constructed by centering a sphere V of volume v around each Ao € V^-(O) and taking all 
combinations of lattice points within this region (keeping Ao as first coordinate). From Fig. |4] it may be 
seen that any Ao which is contained in the region denoted A will always be combined with sublattice 
points that are also contained in V n (0). On the other hand, any Ao which is contained in region B will 
occasionally be combined with points outside T^-(O). Therefore, we need to show that the volume Va of 
A approaches the volume of K-(O) as N w — > 00 or similarly that the ratio of Vb/Va — > as N n — > 00, 
where Vb denotes the volume of the region B. 

Let A be the centered hyper cube having side lengths s' = s — 2r where r is the radius of V, see 
Fig. IU Since the volume of V w (0) is = vN^ it follows that s = v\^ L = (vN 1T ) 1 l L '■ Moreover, the 
volume V~a of A is 

V A = (s') L 

1/L 




1/O-1) \ 1 / L 



L X /L 

rhL N l/L(n-l) 



l,L „ A rl/(»-l) 



where v = ip^ n vN n -'^ n ' is the volume of V and f = {u/ujl) 1 I l , where uj^ is the volume of an 
L-dimensional unit sphere. Since the volume Vb of B is given by Vb = — Va we find the ratio 

V B 



lim 

a^-xxi Va 

= lim - 



TT 



'-^ N ^_ 2 (m 1/L N v«n-i ) 



= 0, 

where the second equality follows since n > 2. 

At this point, we note that the hyper cubic region as used above is actually the worst shape to consider. 
Specifically, it is the one that yields the minimum Va and thus the maximum Vg, since i/ w is constant. 
To see this, note that we can always pick the region A to be a centered scaled version of K-(O). Thus, 
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since the boundary of the inscribed region A will be farthest away from the boundary of V w (0) at corner 
points it follows that the more spherical K-(O), the larger V4 compared to iv This proves the claim. ■ 

Appendix D 
Proof of Theorem [6] 

We only prove it for Ao and Ai. Then by symmetry it must hold for any pair. Define the set S\ as 
the set of n-tuples constructed by centering V at some Ao G T4(0) n Ao- Hence, s G S\ has Ao as 
first coordinate and the distance between any two elements of s is less than r, the radius of V. We will 
assumed that 5 Ao / 0, VA . 

Similarly, define the set S\ ± / by centering V at some Ai G V n (0) n Ai. Recall from Theorem [5] 
that, asymptotically as Ni — > 00, Vi, all elements of the n-tuples are in V n (0). Then it must hold that 
for any s G S\ 1 we have s G UaoSV (o)nA ^ A o- But ^ * s a l so tnat f° r an y s ' e ^A we have 
s' G UaigV (o)nAi^Ai- Hence, since the n-tuples in Ua £V (o)nA ^ D are distinct and the n-tuples in 
UAte^CojnAi^A! a re also distinct, it follows that the two sets UA„el4(o)nA 5 A and \J XieVAo)nAl S Xl 
must be equivalent. ■ 

Appendix E 
Proof of Theorem [8] 

We notice from Lemma [TJ and ( fT3l ) that Di = Ell X — Xe\\ 2 can be written as 



Di = W S A c --^ WQ!i (A c ) 
77 \ c ev„{o) 



K 

iei 



+ | E J v ^ ) fx{x)\\X-\ c \\ 2 dx 



(70) 



,A c eA c 



13 This is always the case if r > maxir(Ai) where r(Ai) is the covering radius of the ith sublattice. The covering radius 
depends on the lattice and is maximized if Aj is geometrically similar to Z L , in which case we have 1211 

r(A0 = \f^N\'\ 

Since r = i^n^^^N^ ^ n / u l ^ follows that in order to make sure that S\ 7^ the index values must satisfy 

Ni < (^2Vn,L) L ^LiVy (n " 1) , i = 0,...,J»-l. (*) 

Through-out this work we therefore require (and implicitly assume) that Q is satisfied. 
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where from (I37T ) we know that the last term is G{K c )v^ L ■ In the following we therefore focus on finding 
a closed-form solution to the first term in (f7Qb . This we do by taking the following three steps (which 
are valid in the usual asymptotical sense): 

1) We first show, by Proposition [Q that 



E 

Ac 614(0) 



Ac ~ ~ E ~ X 3 



= E 

AcGKr(O) 

2) Then, by Lemma [141 we show that 



n-l 



j'G^ ' V ' 8=0 



E 

A c ev„(o) 



i=0 



n k -2 n k -l 



= E EEE<*n**-W 

A o eK(0) fe *=0 i=0 
for some Ck G M and < n. 
3) Finally, we show by Proposition |2] that for the case of n = 3, we have 

2 



E ~ ^ 

A c eK(o) 



cv 2 J L N n \{ Ni 



/L 



m=0 



for some c 6 



In order to establish step 1, we need the following results. 

Lemma 11: For any 1 < k < n and I G CS n > K > we have 



E 

A o €K-(0) 



n-l 



iE^-^E,(4"')A, 



(71) 



V m=0 / 

Proof: Recall that the sublattice points Aj and Aj satisfy ||Aj — Aj|| < r/y/L, where r = (v/ujl) 1 I l 
is the radius of V. Without loss of generality, we let Xj = r and Aj = 0, which leads to 

n-l 



E 

A c €K(0) 



v ' i=0 



< c 



rN. 



n— 1 



^ L V m=0 
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n-l AT l/(n-l) 



where < c G R and v = V^l^c UZ=o ^ 

Proposition 1: For 1 < k < n, I G £( n < K ), — >■ oo and i/j — >■ we have 



E 

A c eK(o) 



E 

AcGKr(O) 



n-l 



i=0 



where Xj = ^ijaj(X c ). 



Proof: Let A = ^rg^Tw EILo* 7(^1™ an d ^' = « Yljei ^i- After some manipulations similar 



7(£("- k >)k ^r=u ' v~i /• •» ' ' k 

to Ifl4l Eqs. (67) - (72)] we obtain the following inequalities: 



1 - 2 



E 



A c ey„(o) 



I A' — AM II A — A c | 



Ea c 



eK(o) 



E h a, -^i 

A c ev„(o) 



< E ii a c - a/ ii 2 

A C G\4(0) 

<l £ ||A'-A|| 2 ) x f 1+ E ^(0) 



(72) 



A C 6K(0) 



A - A r 



X,A o eT4(0) 
|A'- AllllA-A, 



+ 2- 



|A' - A| 



(73) 



Ea c GKt(0) 

We now use the fact that ||A — A c || = 0{NkV c ) l ^ L '» we can upper this distance by the covering radius 
of the sublattice with the largest index value, say N k . By use of Lemma [TT] it is possible to upper bound 
the numerator of the fraction in the l.h.s. of d72l by 



J2 || A' — A || || A — A c 

A c ev;(o) 



n-l 



(74) 



O {N k v c )V L Nyj L [J AtV^-D 



m=0 



At this point we recall that the growth of the denominator in the l.h.s. of d72l is at least as great as (I67T ). 
which leads to the following lower bound 

E H A ' " ^ll 2 = f v c LN * II ^m /i(n_1) J • (75) 
A c eV,(0) V rn=0 / 

By comparing (1741 to (1751 ), it follows that the fractions in d72l ) and ( 1731 go to zero asymptotically as 
Ni -> oo. It follows that 

E ii a c - a 'ii 2 = E u*'-*ii a ( 76 ) 

A c Gy„(o) A c ev^(o) 
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In order to establish step 2, we need the following results. 
Lemma 12: For 1 < k < n and any we have 

k — 2 re— 1 



jg£ i=0 i=i+l 



Proof: We expand the norm as follows 

2 2-1 

= Eha# + 2 E T,(k,k) 

jei jet i=o j=i+l 

= *Eiia,ii 2 -E E wk-k\ 

jet i=0 j=i+l 

Lemma 13: For 1 < k < n and any £ G £( n > K ) we have 

2 (E^'E^(4 n ' K) )AA =7(^ k) )-Eii^i 

\je<? «=o / jel 



n-l 



+ *E^ £ 



(n,re) 



n— 1 



i=0 



2 -EEw k) )iia,-a 

jgi i=0 



Proof: 



I n-l \ n-l 

2 ( E E T(4 n ' K) )Ai ) = 2 E E 7(4 nA) )(A 

n-l 

= -EE7(a ( "' k) )iia,-a,ii 2 

jg£ i=0 
n-l 

+ EE7(A (nA) )(n^ii 2 + ii^ii 2 ) 



n-l 



EEW K) )HA;-A, 



n-l 



+ K 7(^ (n ' K) )EiiA,n 2 + K E^ £ 

where the last equality follows from Lemma @] 



(n,n) 
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Lemma 14: For any 1 < k < n and t £ £( n > K ) we have 



i=0 



1 



n-l 



^(£(^))^^^(4^))||A,-A 



7(£(«>«)) 2 K 2 v 
_^ (£ (^) )2 g g ||A,-A,J 2 

i=0 j=i+l 

n—2 n— 1 

-EE 7(4 n,K) )7(4 n,K) )ii^-^ 

i=o i=«+i 



Proof: We have that 



1 n_1 



i=0 



(/;(».*))! 



n-l 



-27(£^)/^A,,£7(4 ri ' K) )AA) 



E7(4 n,K) )A 



which by use of Lemmas [12] and [13] leads to 

1 1 n 1 



- 7(/:(™. k ))^ , 



k— 2 re— 1 
- (£ (n, K)) 2^ £ ||A^-\| 

i=0 j=t+l 
n-l 



+ 7(£ M )^7(A ( 



i=0 



n—2 n— 1 

-E E 7(4^)7(4^)11^ -*iii 2 

i=0 j"=i+l 

n-l 

-7(£ (n ' K) )^Eii^ii 2 -^ £(n ' K) ) K E^ £ 

j€l 1=0 
n— 1 \ 

+7(^ K) )EE^4 n ' K) )iiA J -A,n 2 

je^ i=o ' 



(n,re) 



(77) 
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n-1 



_^ (£ (n, K))2 g g HA^-A^f (78) 
i=0 j=i+l 

n— 2 n—1 



7t — ^ n — j_ \ 

E E 7(4" ,K) )7(4 n,K) )ii^-^ii7 

j=0 j=i+l 



In order to establish step 3, we extend the proof technique previously used to find ^n,L hi 111311 . Let a m 
denote the number of Ai points at distance m from some Ao G V^-(O). It follows that a fixed Ao G V^-(O) is 
paired with a m distinct Ai points when forming the N w n-tuples. Furthermore, let b m denote the number 
of A2 points which are paired with a fixed (Ao, Ai) tuple. The total number of n-tuples (having Ao as first 
element) is given by 2~2m=i a mb m where r is the radius of V. It was shown in lfT3l that this procedure 
is asymptotically exact for large index values (and thereby large r). 

For a given Ao G K-(O), we seek to find an expression for eT(A ) II* ~~ ^ill 2 wnere 7?'(*) was 
previously defined in the proof of Theorem [2] to be the set of Xj G Aj which is in n-tuples having the 
specific Aj as the ith element. 

Proposition 2: For n = 3, any 1 < L G N, and asymptotically as iVj — > 00, Vi — > 0, Vi, we have 



E E 11* -m 2 

Ao 614(0) A.GTHAO 



L + 2 



G{S^l L vl' L Nl/ L N^ 



(79) 



where is given by ([35]), /3l by ((24| and -03,1, by (l23l . 
Proof: Without loss of generality, we let Ao = so that 

E n* -/ M 2= E ii A -j'ii 2 

A^675(A 4 ) ^675(0) 
1 - 

— _ \ " h 2 

— / j Q"mOmTTl 

m=l 

where we used the fact that m 2 = ||Aj|| 2 /L. 

The first part of the proof follows now by results of lfl3l . Specifically, from (65) in [13] (see also IT361 
(H.43)]) it follows that 

T > , a mb m = 2 -r—PLr (80) 

m=l 
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where it is easy to show that we can replace a m b m by a m b m m 2 and obtain 



1 r 



2 W LWL-1 1 3 2L+2 

,171 = 2 — ■ -pL r 

V\l>2 L + l 

(a) U L UL-1 1 g -2/L-2 1 
2 7TTPi i/ ^ 2+2 /f 



£,., 2 / L PL 



Li PL 
Li PL 

where (a) follows by use of d2lt . i.e. i> = cj^r L = tp^ L u c -\/N^ and (6) follows by use of (|23T ). Finally, 
(c) follows since cj~ 2/L = (L + 2)G(S L ). 

The proof now follows by using the fact that (|80l ) is independent of Ao so that, since there are N v /N 
distinct Aq's in V w (0), we get 



7 y~] /] a m b m m 
A o e\4(0) m=l 

L + 2 



PL 



L 



We are now in a position to prove the theorem. 

Proof of Theorem^ Let A, = /ijO!j(A c ), then asymptotically as iVj — > oo,fj 



71 X e eV w (0) idl 



(a) J. 

~ 2V ff 



1 



— y 

A c eK(o) 
(J J_ \ - 

" AT^ 2^ ^(£(n, K ))2 K 2 
n-1 

7(£^)EE7(4 n '' ?) )l|A,--A i 
ie^ i=o 

_^ (£ (n,«) )2 g g ||A,-A,|| 2 
i=0 j'=i+l 



i=0 



0, Vi, we have that 
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n— 2 n— 1 



II — 6 It, — L \ 

E E 7(A (n,K) )7(4 n,K) )ii^-^-ii 2 ) 



i=0 j=i+l 



(c) 



^( >C (n, K ))2 K 2 



n-1 



7(^ K) )EE^(A (n ' K) ) 



(\ n— 2 n— 1 \ 
J-E E 7(A (n ' K) )7(4 n * K) )j 

' i=0 7=1+1 ' 



^ PL 



1 



7(£(^«))2 K 2 



K 2 7(£ (n - K) ) 2 



)n— 2 n— 1 \ 
-EE 7(A (n ' K) )7(4 n ' K) )j 
i=0 i=i+l ' 



r(£ (n ' K) )E7(4 



i> PL 

where (a) follows by Proposition [T] (6) follows by Lemma [Q] and (c) follows by Proposition |2 The 
proof now follows by observing that the second term of (TTOb is negligible compared to the first term 

of dm ■ 



Appendix F 
Proof of Lemma [3] 

We consider a zero-mean and unit-variance Gaussian source X and define three random variables 
Yi = X + Qi,i = 0,1,2 where the Qi's are identically distributed jointly Gaussian random variables 
(independent of X) with variance cr 2 and covariance matrix Q given by 

1 P P 

Q = a q P 1 P 
f P l . 

where the correlation coefficient satisfies — | < p < ~. It is easy to show that the MMSE when estimating 
X from any set of m 17 s is given by ll6l, f7l 



MMSE r 



a 2 (l + (m-l)p) 
m + cr„(l + (m — l)p) 



In the high-resolution case where cr 2 <C 1 it follows that we have 

MMSE! = a\ 
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and 



MMSE 3 = -oJ(l + 2p). 



It was shown in [7 ] that, the description rate R is given by 




) 



3 



so that 




) 



1 



- 1 



(l-p)-f(l + 2p)-»2- 



where the approximation becomes exact at high resolution (i.e. for R 1). We can now form the 
high-resolution distortion product 



distortion ratio, i.e. it resembles the asymptotical condition of letting iVj — > oo in the IA based approach. 
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